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Interviews condncted in the first phase of a project 
to develop a aethod for user selection of purchased scientific and 
technical inforiation services identified a nuaber of relationship 
aaong different popalatlons of asers* Research scientists^ engineers^ 
and patent attorneys vant convenient access to original data 
Identified in the search* Professional searchers select froa a vider 
range of services* Their selection eaphasizes the convenience of 
Indexing aethods or access to inforaation available and the aaount of 
training and tiae regnired to ase each ^rvice to advantage* 
Inforaation aanagers consider the badget gaestions of cost, tiae, and 
facilities and the feedback froa asers of all the services available* 
To this they add their ovn jadgeaents of repatation, consistent 
standards of gaality, and flexibility to aeet the changing needs of 
specific asers concerned* Also identified as a factor in the 
selection process tras the rapid grotrth of scientific and inforaation 
services vhich aay be reaching a point vhere as aany anst shrink as 
can expand* (Author/PF) 
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FACTORS IN THE SELECTION OF mCHASED SERVICES 



The growth of technology and science leads to new technologies^ 
at an ever increasing rate* Bach new generation in a given field of 
knowledge tends to grow faster, and takes less time to start. This con- 
cept of new generations in technology has some interesting corollaries^, 
as proposed, in I960 by, Derek de Solla Price* A number of these are sunt- 
marized schpnaatically in Figure 1* The initial rate of grot^th with time 
follows an exponential curve, a straight-line logarithmic plot, with a 
constant doubling period ( )* Exactly the same type of curve applies to 
the growth of money at compound interest, or bacteria in a culture, 
universities in European history, scieatific journals In print, and 
theoretical returns from a chain letter, price presents a number of 
illustrations from the history of science, and shows that the initial 
doubling rate for each of these Is remarkably constant* 

The fallacy of the chain letter applies to every growth curve 
which assumes continued escponential growth* Gven the m^^thematics of 
compouiid interest assumes the permanence of an institution which can pay 
it, and a holder who is willing to wait. The hypothetical baiik paying 6% 
a year since 1626 on a deposit of the $24 used to purchase Manhattan from 
the Indians should add $17 billion to the account In 1976, and $68 billion 
for the year 2000. But*..* the whole deal is. off if the bank goes broke, 
or if the impecunious holder decides to cash in his earnings at any time 
over the 350 years. There is always some resource ^ich is consumed by 
growth, and as its disappearance becomes noticeable the expon^tial cuwe 
slows and flattens off to an S-shape, as shown. If the limiting resource 
can be replenished up to a point, like time or available manpower, this 
determines the level ^ich the growth curve approaches as it flattens 
out* llathematically, the S-shaped ^'sigmoid curve** contains an exponent 
which Is diminished by a factor of a(l-oc), where x Is the fraction of a 
vital resource which has been consumed. If tiiere is no means by which 
it can be replenished, like bacteria with a limited food supply or a 
chain letter which has run out of gullible victims, growth goes negative^ 
and the whole system collapses. 

The second point ptice makes is that in the history of science, 
a new technology is often developed and applied some time before the old 
has disappeared. This new technology can benefit from, the methods and 
mistakes of the old, so it grows more rapidly, curve (b) in Figure 1. 
The next generation (c) grows still more rapidly and as it grows, the 
pressure which it creates for the development of succeeding generations can 
appear in a shorter and shorter time* Exaniples are given for the growth 
of scientific journals Cl^^us abstract journals, and mechanical index systans)} 
and for the overall growth of the scientific and technical literature in 
Europe, the United States, the Soviet Union, and China (up to I960). Growth 
rates calculated for the last example correspond to pcogresslvcly shorter 
doubling periods of 15 years, 10 years, 7 years, and 5 years respectively. 
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This regular pattern in the appearance of new generations of 
applied science suggests that there are some consistent factors Involved. 
In each of these cases technology was available^ waiting for a new need 
to develop: the printing press before the modern university^ these and [ 
skilled makers of instruments before the scientific journals began» : 
punched cards before mechanical searching^ and so on* The pressure for 
the new development also involves a qualitative factor: 300 journals are I 
more than any man can conveniently read» so the first abstract journals 
began to appear when the number of primary journals reached 300» and 
mechanical Index systems began to appear when the list of abst:ract journals ' 
approached the same critical number* These can be represented by 'curves 
(a)» (b) and (c) In figure 1* Computerized systems for .access to all of 
these are now appearing in a shorter time» and developing at a much more 
rapid rate (curve d) * 

This family of growth curves has another characteristic which 
Is Important and can be confusing^ In that tli^y overlap at the upper ends* 
Thus at the present: time», computerized access to Information (d) which 
started later than mechanical systems (c) and much later than abstracts (b) 
and primary journals (a) Is growing so much more rapidly that It appears 
as Si clearly dominant feature In the development of access to Information* 
The NSF '*guide to' non-conventional scientific and technical Information 
systems In current use** Indicates that from 1958 to 1966 the number of 
mechanical sorting systems In use showed a doubling period of four years 
(e.g*» edge punched^ tabulating card» peek-a-boo systems)* This rapid 
growth was all but obliterated by computer systaaa which Increased at a 
sustained doubling rate of less than two years^ from 17 In X962 to 118 In 
1966 (out of 175 non-conventional systems reported)* 

■ Overlapping Tools and Services 

The purpose of the present study Is to provide for the user 
of purchased services In scientific and technical Information (STI) a 
guide to factors in the selection process** The simultaneous development 
of different new methods of access to Information confronts the user with 
an uncomfortable choice as to which tools to bu7» and which buttons to 
push* It overlaps significant user-designed improvanents In the older 
familiar systems^ some of which he/she herself^* may have helped create* ^ 

Science and technology have now reached the 4th or 5th generation 
of Information access tools^ with new tools coming on so rapidly that the 
lines between generations are blurred* A host of special services of 
every imaginable type are superimposed on journals which are still developing^ 
along with abstract journals^ mechanical Indexes^ and computer access to 
all of these* The design of new systems and services Is Itself a well*^ 
established discipline^ so that the availability of new technology Is less 
and less of a limit* The number of Information '^services'* available Is In 
the thousands and still growing^ and each of them has been created to meet 
the challenge of specific user needs. 
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** With due apologies for the English language, **he*' will be used hereln- 
- after to Include "she" or "they"; "hers" Is Included with "his" or 

"their"; "himself" equals "herself" or "themselves", etc. 
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Four generations of access tools are identified in Table 1* 
.and these basic types have inany varieties* But a new service must sell 
to stay in business> and the user selection of services is a two-way 
street - the user selects from services available (or pays to build one 
hi]aself)> and only the services that users select remain available ( )* 

The match of needs to users is critical^ and it becomes more 
significant as the alternatives increase* If we consider the types of 
information and services proposed, a useful match appears between cer- j 
tain types of users and the types of access tools or services which 
they select, for certain types of need* - | 

Users and Services | 

■ I 
The proposition we will examine is that there are identifiable 
types of users with different types of needs who will differ in choosing 
one type of service ovsr another, in STI or related fields,. anJ that 
some of their bases of selection can be identified and explored* This 
match between user and type of service is as important an aspect of the 
selection process as the match between needs and services, which has beeit so 
widely discussed* 

The literature on information' is beset by semantic problems* 
The "user" we are considering in this study, the one who" selects an 
information service, may be a scientist, a library searcher, a manager, 
or an information analyst* Except for the irare individual who does all 
his own library work, it Is unusual for the same person to be both ^Vser'^ 
and customer (the one who is asking for Information); in most cases the 
"user" is collecting information for someone else* "Purchased" requires 
that the Service be commercially available arid therefore viable, on the . 
market, as either a'.servicc to order or one available to many users* Our 
study is directed specifically to scientific. .and technical information, 
although similar principles may apply to other areas of knowledge with 
different parameters, e*g*, for time or the nature of data* 

The "typical' user" populations listed in Table 1 are by no 
means mutually exclusive: any of these users can and do use all of the 
types of services described* The table is based on comments received 
in interviews with a number of users grouped to suggest relationships 
between specific types of information, services, users, and needs* 

"Information services" from which any user niay select fall into > 
three major categories: 

^ access tools which the user can use to do his own search*, 
as listed in Table 1; 

- a service that does simple searching for known facts, which the 
user can pay for instead of finding the information himself; 

- a service for information analysis, where the user pays some- 
one else to both find and analyse the Information available* 

The distinction liere is that a "simple search" is one where the 
question is pre*^defined* This may be a lengthy process^ but any change in 
the question once agreed upon is considered as a new search* It is also 
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Table 1 



4 Operations of Informatlotr Services 



Type of Information 

(1) Original data 

(2) References 

(3) Mechanical Indexes 

, (4) Optimisation of search 
(1,2) Current awareness 



Type of Service 
journals (4- books) 

abstracts, indexes 
index to sources 
interactive searching 



newsletters, 
journal colunnlstst 



Typical TTser 



>atlsfled 



Scientist, engineer Details from originals 



Library searcher, 
patent attorney 

Manager, 
planning -staff ^ 

Information analyst 
(any of the above) 

Individual, 
for brovsing or 
specific interests 



Decisions often based on 
abstract or title alone* 

Relative value of sources 
(scientist know this ±n his field) 

Redefinition of search, to 
natch needs, and info available 

Many variants, coverage 
selected by an editor 
or by the individual 



1 
1 
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only a search for facts* or references* not the judgment of facts* As ^ 
corollary of this > a commercial service which does simple searching may 
state that any searcher on the staff* with proper training* can accept 
an Incoming question and come up with the same aaswer* The customer for 
a simple search may get all the original literature and references* or 
he may take selections from ^ report (bibliography) and request specific 
Items* In either case he does his oun evaluating* or arranges to have it 
done* as a separate step after the search Is completed. 

"Information analysis" Introduces a new set of Interactions which 
differ from the simple search: the user continually redefines the question by 
analyzing tihe information obtained during the course of the search. ^*What 
Is**.?" can be a simple search; "What If..." Is quite different^ and requires 
a different level of personal or staff ability and experience.. This may 
Involve conferring with the customer* or the user may do all the analysis 
and supply only a digested product. The same information services* even the 
most sophisticated ones* may be used either for a simple search or for infor*- 
matlon analysis: the difference lies in the user* and how the infor- 
mation tools &nd services are allied. In any case* the information analyst 
is applying ahlgher level of skills than in simple searching* because the 
analyst must understand thoroughly the technical language of the literature 
and the customer's needs* as well as the inner wrklngs of tiie searching 
procedures- used. ( )« ^ - . . 

Types of use can also be characterized by the depth of detail 
required for different searches* as suggested in Table 2. The "types" I 
shown here are the familiar terms used in patent searches* which is one of 
the first Stl areas where the art of searching was developed into com-* 
mercial services. The same terms can be generalized for other u^es: a 
state-of-the-art review has a similar function before starting a new 
project* whether this be in research* marketing* manufacture^ or a patent 
application* This is for **how to do*" whereas the novelty search is for 
**exactly what (not) to do.** Both of these are frequently a simple search*' 
where the subject is exactly defined the search can be completed as ordered* 
The customer receives and studies for best possible use the search he has 
paid for* and with the knowledge thus acquired he makes a new decision 
whether to order a further search. Infringraent suits* contract negotia- 
tions or questions of liability are more likely to Involve the information j 
analysis approach^ redefining both the question and the concept of needs* . i 
for the best use of the information available* 

Dimensions in the Selection Process ^ ^ 

Economic principles dictate that the user should purchase Informa- ' 
tion services whenever he can buy information in the form that he needs and 
can use> for less than it would cost him to get the same Information other- 
wise. This situation includes many hidden factors* such as the value of pro- 
cessing time and proprietary concerns. There are also strong negative values 
that are frequently C3verlooked> for information which consumes time and space 
because it is considered "useful** but never used. Values to any user involve 
aspects in the selection between services which are highly individual^ such 
as the user^s personal facilities* interests^ and ability (or inability) to 
use certain types of Information to ac^vantage if it does become available. 
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Type of Search 
State of the Art 

Novelty 

Contracts 

Liability 



Use 



project planning^ 
background 

specific dttta,^ 



positive and negative 

define limitations*' 
ranges* alte rnatives 

govt* regulations* 
civil limits*- caveats 
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Table 2 



Depth of Detail 



Frdject Type 



Characteristics 



for research* 

iriarketljig* or tnanufflctyre 

during research* " ■ 
m^rketljig* .manufacture 

for negotiations* 
infrin gement study 



overview* broad* moderate depth; what 
has been done and how* 

what works and doesn't work; what wiil 
appeal to the public; preferred methods 

what will other managers pay for 



all of the above 
(FDA* ERA* etc*) 



evaluated technology} differences; best 
available* ultimate effects 
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The literature on the evaluation of Inforntatlon systems Is 
volurilnouS) confusing, and often contradictory* Much of this literature 
reflects strong Individual points of vlew» written by the purveyors of 
Information services who emphasize their concern with loatters of cost» or 
by system managers concerned with the value of time. They agree with each 
oth^r on the importance of cost» where other users n^y not* There Is a 
basic reason for this in that both ar& in a sense vendors, who must sell 
their time and services to someone el^e to stay in busines* Each author 
chooses carefully his own meanings for key words, and the concepts they 
identify, to give a new slant to old problems* These authors are often 
skilled linguists who draw subtle distinctions betwen the concepts they 
discuss, but they have only so many words to draw on, and the resultant 
confusion is inevitable* As a simple example, the literature on the 
"evaluation of information systems^^ has groim rapidly during the past 10 
years ( ), but most of this evaluation has been aimed at improvements in 
the design and operation of single systems, not the gomparatlve evaluation 
of different systems* 

This literature started with a heavy .emphasis on factors in cost 
( ), and gradually changed over the years to include cost/effectiveness and 
cost/benefit factors ( )* These are progressively more difficult to quantify, 
involving subjective elements* Many authors have recognized and bemoaned 
the problems of evaluating complex variables^ containing both objective 
and subjective elements whlc'h cannot be exactly measured ( )* The total 
number of factors recognizable in the selection between services can be 
expanded almost at will: a. recent checklist recognizes 144 of them, under 
7 different headings* Many of these are closely linked, however, and are 
not independent variables ( )* 

A dimensionaL approach to this complex system is recommended* 
The idea is to group variables which-are so blinked that they tend' to 
move together in any change or comparison* Table 3 suggests that cost^ 
time, personnel, and physical facilities can be considered as one such 
group. In the dimension of quantifiable factors* That is to say, any 
circumstance which has a major effect on cost, time^ facllltles^or staff 
requirements is likely to have some effect on other variables in the 
same group* A second dimension which is well recognized includes the whole 
gamut of qualitative factors that cannot be measured exactly but which 
can be handled by the technique of subjective ranking* The exact names 
given to different factors or relationships in this group are harder to 
handle than the fact that so many of them tend to be interrelated^ and 
move together when any of them is significantly changed ( )* 

. ■ I 

The decision process is not based just on facts and personal | 
preferences, however* Eloquent testimony on this can be offered by many \ 
a development engineer who is baffled when management has turned down \ 
a pet project that looked very good on paper* Managem^t judgment tends 
to be a yes/no answer* This judgmental dimension is hard to argue with, 
based on neither numerical facts nor subjective rankings alone but a blend 
of these with intuition, based on experience ( )* It: often Involves a major 
contribution from the judgment of other managers* It is harder to define 
and less often dlscu£tsed in the literature on information systems than either 
cost or cost/e£f iclencies/beneflts, but perhaps this is only because it is 
so often taken for granted* 
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Table 3 

Bimensions in the Selection Process: 



Quantitative 



Qualitative 



Business Judgment 



Cost 

Coverage 
Time^ for Entry 

Format 

Flexibility , 
Responsiveness 

Feedback 
Reputation 

Viability 
Consistency ' 



Cos t/ ef f Iclency > 
Cost /benefits 

Fields> numbers> X 

Text and Index 

Appearance 
Convenient Access ' " 

Bepth can be varied 

Ctutnge priorities,, 
add n€V Items 

To/frost user ' 

"Our way of doing things 
Fast recommendations 
Uniformity of quality 

Will it last 

Dependable bias 
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The dimensional approach to the analysis of complex variables 
in project evaluation was advanced IS years ago for the rational selection 
between projects in the management of industrial research* Harris (Monsanto) 
described a profile scheme with 5 "aspects" as headings for 26 factors^ each 
ranked on a four-unit scale from very good to very bad ( )* This system for 
'the evaluation of research was not widely odopted^ and later studies suggested 
that 5- major headings is still too cumbersome* A strictly limited numiber 
of dimensions is preferred ( )* Three dimensions has this advantage^ and 
is the minimum required to escape the hazard of false cause/effect con- 
clusions from two^lmensional thinking* 

The usefulness of the three dimensions proposed in Table 3 tends 
to be con£irmed by the^ fact that their order of importance is quite dif- ' 
ferent to different users* Initial comments received from different * 
populations of users suggest the apparent relationships shmm in Table 4* 
These are now being examined in further interviews! 

^ The scientist/engineer chooses first of all th'3t service he 
finds most convenient to use* He accepts the judgment of. 
a manager as to what systems to consider > and he pays 
little attention to the quantifiable factors of cost> time> 
or facilities as long as the systems available give him 
the answers he needs* 

- The planning staff or information manager makes a first 
choice on whether ,the service In question is rellable> 
likely to stay in business > or ''suits our way of doing 
things*" He has to consider budgets on all the quantifiable 
factors^ and may include qualitative factors only aftar he 
has ruled out services which he finds unreliable or too 
expensive* 

^ The literature on information systems emphasizes cost> tlme> 
and all the' quantifiable factors a vendor must control to 
keep his customers* Qualitative factors are recognized in 
cost/benefit studies^ but somewhat grudgingly because they / 
cannot be accurately measured* Judgment as a separate 
dimension is well recognized in discussions on business \ 
manag^ent^ but not usually in the' literature on informa- 
tion services* 

Initial interviews with a group of six searchers and scientists 
in the broad field of petroleum-related chemistry and industry jarovided a 
list of the information searching tools they consider most useful in their 
daily work> Table 5* This list showed a high degree of agreement^ with minor 
differences in the order for specific individuals* Ho such agreement appeared 
in e£forts to prepare a broador list of this type> to rank the 30 to SO 
abstracting/indexing services the group considered most useful; titles and 
rankings beyond the few in Table 5 were completely different for each user/ 
searcher^ or for the same searcher for different searches* The next question 
was to prepare a trial list of discriminating factors which these searchers 
recognize as a basis for the selection between services* These factors expand 
the table into a grld> which is not shown here because it involves diverse 
statements of opinion on matters of fact* These differences in opinion are 
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Table 4 



APPABEHT SXGHXFICANCE TO GROUPS OF aSERS 



Dimensions 
(Grogps of Factors) 

Quant£fl8ble> numeric 
(cost> tliiie> facilities) 



Approximate 
Order of Siitnlflcance . „^ 

1 literature on systems 

2 searches > manager 

3 scientist^- attorney - 



Selected Comments 



vendor? vant all the data they can find 
balance time and costs against quality 
choose quality and dependability before costs 



Quail tatlve>jran]c^^ 



(subjective* conVenlencey 



1 scientist* searcher- 

2 literature 

3 manager* planner 



use what I like best> on list ''approved" by others 
Component of all cost/benefit analysis 
consider it only for services **relllable"> 
- on the market 



Judgmental* yes/no 

( intuit lon> experiential) 



1 manager > planner 

2 . sclentlst> searcher' 

3 ^ literature 



fits our way- of doing business; will It last 
Is It dependable 
de-^emphasized; not "measurable" 



Table 5 



^^Unique" Services, 
Most Used 

Chemical Abstracts 

t 

Index Hard Copy 
Text Microfilm . 

Derwent - C,P,I, 

API Abstracts: ' 

Patents and 
Literature 

Science Citatloir Index 



Predlcasts, 
CHA, Funk-Scott 

Engineering Index 

Applied Science and 
Technology Index 



Bases for Comparison 

Fields covered 

Cost $/yr 
Shelf space/yr 

Timeliness: text *f Index 

User requirements 
training 

sfciUs„ ; 

tttnimum use; required 
Maintenance time 

Conpents , " ■ . 
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being explored as possible leads for new factors » or the llnVlng of the 
factors named* Cost data were available from departmental staff » but 
they vere not usually mentioned or even well known by the searchers* 

The factors tabulated tend to be quantitative, and the comments 
qualitative or a complex of both* Factors in the dimension of judgment 
are applied to put or Veep services on the llst» but this decision Is made 
at a different time and place* Once made» It Is not a significant factor 
in the selection between services for dally work* Follow-nip Interviews 
Indicate that users at other locations may be less Interested in patents^ 
or they may consult C*A* less and other services euch as HEDLAKS or BIOSIS 
more» but they apply much the same discriminating factors In selecting 
among them.^ 

Status and Conclusions- ' ^ , ' 

A number of relationships can be Identified among different: . : - 
populations- of users* In general^, research scientists and engineers ^ 
agree that they want convenient access to original data Identified In 
the search; the engineers want quick access to representative data» while 
the research scientists more often want details from all the different^ ' ' ' 
originals for comparison* ^ The patent attorney also .wants selected 
originals* but he is usually more Interested in exact '.wording than In. ' ' 
any data*. Professional searchers select from'^.a wider range of services* 
which they know how to use* Their selection emphasizes the Convenience' 
of indexing methods or access to Information available, and the amount of 
training and time required to use each service to advantage* Patent 
attorneys and planning staff both usually have a well-defined question* 
and they emphasize, wanting to deal with an Individual searcher ^whom they ,'^ 
know, who will understand their Inatructlohs and^use tRutuall^r acceptable 
criteria in the selection of .references* . Information maiiagera consider 
all the budget questions of cost» time and facilities* and tba feedback 
from users of all the services available) they then 'add to this th^ir - 
own judgment of reputation, consistent standards of quality, 'and flexibility 
of each service to meet the changing needs of specific users 'concerned*. 
This match between users and use is not random, and , it Ig as important as i 
any other aspect in the match between user needs and services* 

Additional correlations of thla type are being developed from 
Interviews with a' larger group of users In each of these populations* Special 
groups are also being considered, such as all the users and staff of a 
small branch industrial library* The present report covers the first six 
months of a study which started with user interviews in a major industrial 
research company » and is now branching out to other users in different 
disciplines and organizations of different size* A special search of the 
literature was completed but its analysis was deferred to permit the examlna^ 
tlon of reasons for some of the strong differences in points of view 
expressed* This search is nor/ being checked against the conclusions out- 
lined to date for additional data and differences* 
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The dimensions and factors proposed in Table 3 with respect to 
services in scientific and technical inrorination have obvious analogies 
which may be useful in other areas. Comparable quantitative parameters 
vhich are limiting in biological systems include the total food supply 
(= total budget^ or all the data available)* total living space (■* total 
vPlume or storage capacity), and time vs* metabolic rate time to get 
data> or time to digest data vs. total lifetime of the system). Fara** 
meters and problems In the relationship between costs and benefits are 
also being actively explored in many areas 'of pollution control ( ). 

The rapid acceleration in the development of new technologies 
in STI may be approaching the point in the competition between systems 
where as many must shrink as can expand, and in the limit as many must die 
as can be bom. This conclusion is not absolute, but there is a limiting 
parameter: the percentage of time available which is devoted to informa*- 
tion services (or any other one area) can only be increased at the expense 
of other major areas, in research, development, or production. 
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